Transforming the cardiometabolic disease landscape: Multimodal AI-powered approaches in prevention and management.

The rise of artificial intelligence (AI) has revolutionized various scientific fields, particularly in medicine, where it has enabled the modeling of complex relationships from massive datasets. Initially, AI algorithms focused on improved interpretation of diagnostic studies such as chest X-rays and electrocardiograms in addition to predicting patient outcomes and future disease onset. However, AI has evolved with the introduction of transformer models, allowing analysis of the diverse, multimodal data sources existing in medicine today. Multimodal AI holds great promise in more accurate disease risk assessment and stratification as well as optimizing the key driving factors in cardiometabolic disease: blood pressure, sleep, stress, glucose control, weight, nutrition, and physical activity. In this article we outline the current state of medical AI in cardiometabolic disease, highlighting the potential of multimodal AI to augment personalized prevention and treatment strategies in cardiometabolic disease.

The hospital at home in the USA: current status and future prospects.

The annual cost of hospital care services in the US has risen to over $1 trillion despite relatively worse health outcomes compared to similar nations. These trends accentuate a growing need for innovative care delivery models that reduce costs and improve outcomes. HaH-a program that provides patients acute-level hospital care at home-has made significant progress over the past two decades. Technological advancements in remote patient monitoring, wearable sensors, health information technology infrastructure, and multimodal health data processing have contributed to its rise across hospitals. More recently, the COVID-19 pandemic brought HaH into the mainstream, especially in the US, with reimbursement waivers that made the model financially acceptable for hospitals and payors. However, HaH continues to face serious challenges to gain widespread adoption. In this review, we evaluate the peer-reviewed evidence and discuss the promises, challenges, and what it would take to tap into the future potential of HaH.

AI-Enhanced Reconstruction of the 12-Lead Electrocardiogram via 3-Leads with Accurate Clinical Assessment.

The 12-lead electrocardiogram (ECG) is an integral component to the diagnosis of a multitude of cardiovascular conditions. It is performed using a complex set of skin surface electrodes, limiting its use outside traditional clinical settings. We developed an artificial intelligence algorithm, trained over 600,000 clinically acquired ECGs, to explore whether fewer leads as input are sufficient to reconstruct a full 12-lead ECG. Two limb leads (I and II) and one precordial lead (V3) were required to generate a reconstructed synthetic 12-lead ECG highly correlated with the original ECG. An automatic algorithm for detection of acute myocardial infarction (MI) performed similarly for original and reconstructed ECGs (AUC=0.94). When interpreted by cardiologists, reconstructed ECGs achieved an accuracy of 81.4±5.0% in identifying ST elevation MI, comparable with the original 12-lead ECGs (accuracy 84.6±4.6%). These results will impact development efforts to innovate ECG acquisition methods with simplified tools in non-specialized settings.

Toward the eradication of medical diagnostic errors.

The medical community does not broadcast the problem, but there are many studies that have reinforced a serious issue with diagnostic errors. A recent study concluded: "We estimate that nearly 800,000 Americans die or are permanently disabled by diagnostic errors each year." Diagnostic errors are inaccurate assessments of a patient's root cause of illness, such as missing a heart attack or infection or assigning the wrong diagnosis of pneumonia when the correct one is pulmonary embolism. Despite ever-increasing use of medical imaging and laboratory tests intended to promote diagnostic accuracy, there is nothing to suggest improvement since the report by the National Academies of Sciences, Engineering and Medicine in 2015, which provided a conservative estimate that 5% of adults experience a diagnostic error each year, and that most people will experience at least one in their lifetime.

A foundation model for generalizable disease detection from retinal images.

Medical artificial intelligence (AI) offers great potential for recognizing signs of health conditions in retinal images and expediting the diagnosis of eye diseases and systemic disorders1. However, the development of AI models requires substantial annotation and models are usually task-specific with limited generalizability to different clinical applications2. Here, we present RETFound, a foundation model for retinal images that learns generalizable representations from unlabelled retinal images and provides a basis for label-efficient model adaptation in several applications. Specifically, RETFound is trained on 1.6 million unlabelled retinal images by means of self-supervised learning and then adapted to disease detection tasks with explicit labels. We show that adapted RETFound consistently outperforms several comparison models in the diagnosis and prognosis of sight-threatening eye diseases, as well as incident prediction of complex systemic disorders such as heart failure and myocardial infarction with fewer labelled data. RETFound provides a generalizable solution to improve model performance and alleviate the annotation workload of experts to enable broad clinical AI applications from retinal imaging.

As artificial intelligence goes multimodal, medical applications multiply.

Machines don't have eyes, but you wouldn't know that if you followed the progression of deep learning models for accurate interpretation of medical images, such as x-rays, computed tomography (CT) and magnetic resonance imaging (MRI) scans, pathology slides, and retinal photos. Over the past several years, there has been a torrent of studies that have consistently demonstrated how powerful "machine eyes" can be, not only compared with medical experts but also for detecting features in medical images that are not readily discernable by humans. For example, a retinal scan is rich with information that people can't see, but machines can, providing a gateway to multiple aspects of human physiology, including blood pressure; glucose control; risk of Parkinson's, Alzheimer's, kidney, and hepatobiliary diseases; and the likelihood of heart attacks and strokes. As a cardiologist, I would not have envisioned that machine interpretation of an electrocardiogram would provide information about the individual's age, sex, anemia, risk of developing diabetes or arrhythmias, heart function and valve disease, kidney, or thyroid conditions. Likewise, applying deep learning to a pathology slide of tumor tissue can also provide insight about the site of origin, driver mutations, structural genomic variants, and prognosis. Although these machine vision capabilities for medical image interpretation may seem impressive, they foreshadow what is potentially far more expansive terrain for artificial intelligence (AI) to transform medicine. The big shift ahead is the ability to transcend narrow, unimodal tasks, confined to images, and broaden machine capabilities to include text and speech, encompassing all input modes, setting the foundation for multimodal AI.

Retinal Optical Coherence Tomography Features Associated With Incident and Prevalent Parkinson Disease.

BACKGROUND AND OBJECTIVES: Cadaveric studies have shown disease-related neurodegeneration and other morphological abnormalities in the retina of individuals with Parkinson disease (PD); however, it remains unclear whether this can be reliably detected with in vivo imaging. We investigated inner retinal anatomy, measured using optical coherence tomography (OCT), in prevalent PD and subsequently assessed the association of these markers with the development of PD using a prospective research cohort. METHODS: This cross-sectional analysis used data from 2 studies. For the detection of retinal markers in prevalent PD, we used data from AlzEye, a retrospective cohort of 154,830 patients aged 40 years and older attending secondary care ophthalmic hospitals in London, United Kingdom, between 2008 and 2018. For the evaluation of retinal markers in incident PD, we used data from UK Biobank, a prospective population-based cohort where 67,311 volunteers aged 40-69 years were recruited between 2006 and 2010 and underwent retinal imaging. Macular retinal nerve fiber layer (mRNFL), ganglion cell-inner plexiform layer (GCIPL), and inner nuclear layer (INL) thicknesses were extracted from fovea-centered OCT. Linear mixed-effects models were fitted to examine the association between prevalent PD and retinal thicknesses. Hazard ratios for the association between time to PD diagnosis and retinal thicknesses were estimated using frailty models. RESULTS: Within the AlzEye cohort, there were 700 individuals with prevalent PD and 105,770 controls (mean age 65.5 ± 13.5 years, 51.7% female). Individuals with prevalent PD had thinner GCIPL (-2.12 µm, 95% CI -3.17 to -1.07, p = 8.2 × 10-5) and INL (-0.99 µm, 95% CI -1.52 to -0.47, p = 2.1 × 10-4). The UK Biobank included 50,405 participants (mean age 56.1 ± 8.2 years, 54.7% female), of whom 53 developed PD at a mean of 2,653 ± 851 days. Thinner GCIPL (hazard ratio [HR] 0.62 per SD increase, 95% CI 0.46-0.84, p = 0.002) and thinner INL (HR 0.70, 95% CI 0.51-0.96, p = 0.026) were also associated with incident PD. DISCUSSION: Individuals with PD have reduced thickness of the INL and GCIPL of the retina. Involvement of these layers several years before clinical presentation highlight a potential role for retinal imaging for at-risk stratification of PD.

The imperative for regulatory oversight of large language models (or generative AI) in healthcare.

The rapid advancements in artificial intelligence (AI) have led to the development of sophisticated large language models (LLMs) such as GPT-4 and Bard. The potential implementation of LLMs in healthcare settings has already garnered considerable attention because of their diverse applications that include facilitating clinical documentation, obtaining insurance pre-authorization, summarizing research papers, or working as a chatbot to answer questions for patients about their specific data and concerns. While offering transformative potential, LLMs warrant a very cautious approach since these models are trained differently from AI-based medical technologies that are regulated already, especially within the critical context of caring for patients. The newest version, GPT-4, that was released in March, 2023, brings the potentials of this technology to support multiple medical tasks; and risks from mishandling results it provides to varying reliability to a new level. Besides being an advanced LLM, it will be able to read texts on images and analyze the context of those images. The regulation of GPT-4 and generative AI in medicine and healthcare without damaging their exciting and transformative potential is a timely and critical challenge to ensure safety, maintain ethical standards, and protect patient privacy. We argue that regulatory oversight should assure medical professionals and patients can use LLMs without causing harm or compromising their data or privacy. This paper summarizes our practical recommendations for what we can expect from regulators to bring this vision to reality.

Foundation models for generalist medical artificial intelligence.

The exceptionally rapid development of highly flexible, reusable artificial intelligence (AI) models is likely to usher in newfound capabilities in medicine. We propose a new paradigm for medical AI, which we refer to as generalist medical AI (GMAI). GMAI models will be capable of carrying out a diverse set of tasks using very little or no task-specific labelled data. Built through self-supervision on large, diverse datasets, GMAI will flexibly interpret different combinations of medical modalities, including data from imaging, electronic health records, laboratory results, genomics, graphs or medical text. Models will in turn produce expressive outputs such as free-text explanations, spoken recommendations or image annotations that demonstrate advanced medical reasoning abilities. Here we identify a set of high-impact potential applications for GMAI and lay out specific technical capabilities and training datasets necessary to enable them. We expect that GMAI-enabled applications will challenge current strategies for regulating and validating AI devices for medicine and will shift practices associated with the collection of large medical datasets.

Long COVID: major findings, mechanisms and recommendations.

Long COVID is an often debilitating illness that occurs in at least 10% of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections. More than 200 symptoms have been identified with impacts on multiple organ systems. At least 65 million individuals worldwide are estimated to have long COVID, with cases increasing daily. Biomedical research has made substantial progress in identifying various pathophysiological changes and risk factors and in characterizing the illness; further, similarities with other viral-onset illnesses such as myalgic encephalomyelitis/chronic fatigue syndrome and postural orthostatic tachycardia syndrome have laid the groundwork for research in the field. In this Review, we explore the current literature and highlight key findings, the overlap with other conditions, the variable onset of symptoms, long COVID in children and the impact of vaccinations. Although these key findings are critical to understanding long COVID, current diagnostic and treatment options are insufficient, and clinical trials must be prioritized that address leading hypotheses. Additionally, to strengthen long COVID research, future studies must account for biases and SARS-CoV-2 testing issues, build on viral-onset research, be inclusive of marginalized populations and meaningfully engage patients throughout the research process.